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ABSTRACT 


The  Iowa  Department  of  Economic  Development  (IDED)  oversees  a  broad 
range  of  economic  development  programs  and  services  designed  to  meet  the  needs 
of  individuals,  companies  and  communities.  Evaluating  economic  incentive 
programs  can  help  determine  what  works  and  what  does  not  work  for  an  individual 
state.  The  effectiveness  of  economic  incentive  programs  is  largely  unknown.  The 
purpose  of  this  study  is  to  determine  how  the  IDED  can  measure  the  effectiveness 
and  performance  of  its  economic  incentive  programs.  A  performance  evaluation 
methodology  developed  by  Todd  Calhoun  was  utilized  to  organize  the  economic 
development  objectives  of  key  IDED  stakeholders  into  a  Global  Hierarchy.  IDED 
program  objectives  were  then  linked  to  the  Global  Hierarchy  to  demonstrate  that 
IDED  objectives  were  in  alignment  with  State  objectives.  The  performance 
indices  developed  serve  as  an  example  of  how  to  complete  the  process  of  breaking 
down  objectives  into  specific  indicators  of  performance 
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INTRODUCTION 


A.  BACKGROUND 

1.  State  and  Local  Economic  Development 

State  and  local  governments  utilize  a  wide  variety  of  methods  to  encourage 
economic  development.  Individual  states  spend  tens  of  millions  to  hundreds  of 
millions  of  dollars  annually  on  economic  development  programs  (Snell,  1998,  p. 
6).  Defenders  of  economic  incentives  contend  that  incentives  are  necessary  and 
valuable: 

•  They  encourage  job  creation  and  keep  firms  from  moving; 

•  They  allow  historically  imderdeveloped  states  to  catch  up  with  other 
states; 

•  They  level  competitive  differences  among  the  states; 

•  They  benefit  business  nationally  by  prompting  states  to  make  tax  and 
regulatory  policies  more  uniform;  and 

•  They  reduce  the  tax  burden  on  business. 

•  Critics  of  incentives  contend: 

•  They  create  windfalls  for  business; 

•  The  jobs  they  create  in  a  state  are  simply  stolen  from  other  states; 

•  They  reduce  funding  for  education,  transportation  and  other 
government  services  that  are  necessary  for  economic  growth; 

•  They  create  inequities  among  industries  and  firms  within  a  state; 
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•  They  foster  voters’  suspicion  that  government  is  a  matter  of 
giveaways  and  insider  deals; 

•  They  are  a  zero  sum  game  for  the  national  economy;  and 

•  Governments  should  minimize  their  interference  with  the  private 
sector  (Snell,  1998,  pp.  2-3). 

Creating  a  state  strategy  for  economic  development  is  one  way  for 
legislators  and  other  policy  makers  to  resolve  these  issues  (Snell,  1998,  p.  3).  The 
primary  goal  is  to  outline  state  programs  that  are  specifically  intended  to  promote  a 
good  business.  A  state’s  business  climate  is  usually  defined  as  its  reputation  in  the 
business  community  for  being  accommodating  and  responsive  to  the  needs  of 
business.  The  main  argument  for  this  strategy  is  that  businesses  will  relocate  to, 
expand  within,  or  remain  in  states  with  favorable  business  climates  (Lynch,  1996, 
p.  5). 

Incentives  for  economic  policy  can  be  grouped  into  several  broad  categories 
such  as  tax  policy,  loans  and  loan  guarantees,  and  infirastructure  finance.  The  Iowa 
Department  of  Economic  Development  utilizes  all  of  these  methods  to  various 
degrees. 

2.  Iowa  Department  of  Economic  Development 

The  Iowa  Department  of  Economic  Development  (IDED)  has  a  broad  range 
of  programs  and  services  designed  to  meet  the  needs  of  individuals,  companies  and 
communities.  Their  mission  is  “to  continually  develop  the  economic  well  being 
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and  quality  of  life  of  lowans”  (IDED  Owner’s  Manual,  1995,  p.  ii).  IDED 
oversees  a  wide  variety  of  business  financial  assistance  programs  designed  to 
encourage  the  growth  and  profitability  of  businesses  expanding  in  the  state  and 
create  quality  job  opportunities.  The  following  is  a  broad  overview  of  the 
programs  administered  by  IDED. 

a.  Community  Economic  Betterment  Account  (CEBA) 

The  CEBA  provides  financial  assistance,  through  loans  and 
forgivable  loans,  to  businesses  that  plan  to  make  a  capital  investment  and  create 
new  jobs  and/or  retain  existing  jobs.  Assistance  is  provided  to  encourage  new 
business  start-ups,  expansion  or  retention  of  existing  businesses,  or  recruiting  out- 
of-state  businesses  into  Iowa.  Eligible  projects  include:  building  construction  or 
reconstruction,  land  acquisition,  equipment  purchases,  operating  and  maintenance 
expenses,  and  clearance,  demolition  and  removal  of  buildings  to  develop  sites. 
Cities,  counties  or  commimity  colleges  on  behalf  of  eligible  businesses,  which 
meet  certain  wage  standards  for  the  county,  file  applications. 

b.  Economic  Development  Set-Aside  Program  (EDSA) 

The  EDSA  program  provides  assistance  to  businesses  by  granting 
direct  loans  and  forgivable  loans  to  businesses  that  plan  to  make  a  capital 
investment  and  create  and/or  retain  quality  employment  opportunities  for  low-  and 
moderate-income  employees.  Cities,  counties  or  community  colleges  on  behalf  of 
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eligible  businesses,  which  meet  certain  wage  standards  for  the  county,  file 
applications. 

c.  Entrepreneurial  Ventures  Assistance  (EVA) 

The  EVA  program  provides  financial  and  technical  assistance  to 
begiiming  companies  that  must  be  located  in  Iowa  and  in  a  sector  offering  the 
greatest  start-up  and  growth  potential  for  the  state.  Sectors  include  biotechnology, 
recyclable  materials,  software  development  and  computer-related  products, 
advanced  materials,  advanced  manufacturing,  and  medical/surgical  instruments. 
An  initial  investment  may  be  awarded  for  product  development,  working  capital, 
purchasing  machinery/equipment,  or  other  qualifying  business  expenses. 

d.  New  Jobs  and  Income  Program  (NJIP) 

NJIP  benefits  include  withholding,  investment,  and  R&D  activity 
corporate  tax  credits.  Eligibility  is  based  in  part  on  job  creation,  quality  of 
employment,  benefits  for  the  state  and  local  community,  capital  investment,  and 
not  closing  or  significantly  reducing  operations  elsewhere  in  Iowa  in  order  to 
relocate  the  operation.  Since  implementation  in  1994,  NJIP  has  generated  nearly 
$2  billion  in  new  capital  investment. 

e.  Enterprise  Zones 

An  Enterprise  Zone  is  an  area  of  a  city  or  county  targeted  for 
redevelopment  based  on  economic  weakness.  Businesses  expanding  or  locating  in 
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an  Enterprise  Zone  may  receive  property  tax  exemptions  and  expanded  state  tax 
credits. 

Eligibility  is  based  in  part  on  job  creation,  quality  of  employment, 
benefits  for  the  state  and  local  community,  capital  investments  and  not  being  a 
retail  establishment.  Counties  are  eligible  if  they  rank  among  the  bottom  twenty- 
five  counties  in  average  weekly  wage  rate  and  rank  among  the  top  twenty-five 
counties  in  family  poverty  rate,  percentage  population  loss,  or  percentage  of 
persons  over  sixty-five.  Cities  are  eligible  if  they  have  per  capita  income  of 
$9,600  or  less,  family  poverty  rate  of  twelve  percent  or  hi^er,  housing  vacancy  of 
ten  percent  or  more,  property  values  at  seventy-five  percent  or  less  of  the  city  wide 
average,  and  match  the  Iowa  Code  definition  of  a  “blighted”  area. 

f.  Value-Added  Agricultural  Products  and  Processes 
Financial  Assistance  Program  (VAAPFAP) 

VAAPFAP  provides  grants  and/or  loans  to  projects  utilizing 
agricultural  commodities.  Awards  are  based  on  project  feasibility,  utilization  of 
Iowa  commodities,  and  new  or  innovative  products  or  processes. 

g.  Targeted  Small  Business  Financial  Assistance  Program 
(TSBFAP) 

The  TSBFAP  program  assists  in  creating  and  e5q)anding  minority- 
and  women-owned  businesses  through  low  interest  loans,  loan  guarantees  or 
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equity  loans.  Eligible  applicants  are  businesses  with  $3  million  or  less  in  annual 
sales  and  certified  as  a  Targeted  Small  Business. 

h.  Self-Employment  Loan  Program  (SELF) 

The  SELF  program  is  designed  to  assist  low-income  entrepreneurs 
by  providing  low-interest  loans  for  new  or  expanding  small  businesses.  Applicants 
must  meet  Job  Training  Partnership  Act  or  equivalent  low-income  eligibility 
guidelines,  or  persons  with  disabilities  guidelines. 

i.  Entrepreneurs  With  Disabilities  (EWDI) 

The  EWDI  program  is  a  collaborative  effort  of  the  Department  of 
Education,  Division  of  Vocational  Rehabilitation  Services,  Department  for  the 
Blind,  and  the  IDED.  It  provides  technical  and/or  financial  assistance  to  qualified 
individuals  with  disabilities  seeking  self-sufficiency  by  establishing,  maintaining, 
expanding  or  acquiring  a  small  business. 

Services  include  technical  assistance  for  business-related  services 
and/or  financial  assistance  for  purchasing  business  equipment,  supplies,  inventory, 
rent  or  other  start-up,  expansion  or  acquisition  costs  identified  in  an  approved 
business  plan. 

j.  Iowa  Capital  Corporation  (ICC) 

The  ICC  is  a  for-profit  venture  capital  corporation  established  with 
state  funds  and  equity  investments  by  private  institutions.  It  provides  an  attractive 
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risk-adjusted  rate  of  return  on  investment  to  the  corporation’s  shareholders  and 
advances  economic  development  in  Iowa.  Financing  may  take  many  forms  and  is 
tailored  to  the  particular  business  situation. 

k.  Infrastructure  Financial  Assistance  Programs 

Infrastructure  Financial  Assistance  Programs  finance  rail,  road  and 
community  infrastructure.  The  Rail  Economic  Development  Program  funds 
construction  or  rehabilitation  of  rail  spurs.  The  Revitalize  Iowa’s  Sound  Economy 
program  funds  expenditure  on  city,  county  and  state  highways.  The  Public 
Facilities  Set-Aside  Program  provides  financial  assistance  to  cities/counties  to 
provide  infrastructure  improvements  for  businesses.  Assistance  is  limited  to  grants 
to  cities  and  counties;  grants  cannot  exceed  two-thirds  of  the  total  cost  of  the 
improvements  needed. 

L  Tax  Increment  Financing  (TIF) 

TIF  uses  tax  revenue  growth,  produced  by  increases  in  the  tax  base 
of  a  specified  area,  to  repay  the  costs  of  investment  in  the  area.  City  councils  or 
county  boards  of  supervisors  may  use  the  property  taxes  resulting  from  an  increase 
in  taxable  valuation  due  to  construction  of  new  industrial  or  commercial  facilities 
to  provide  economic  development  incentives  to  a  business  or  industry. 
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These  programs  constitute  the  methods  approved  by  the  State  of 
Iowa  and  managed  by  the  Iowa  Department  of  Economic  Development  to  create  a 
good  business  climate. 

3.  Economic  Incentives  and  Government 

How  much  state  tax  policy  affects  economic  growth  is  a  hotly  debated 
issue.  Legislators  and  state  economic  development  personnel  usually  agree  that 
tax  incentives  foster  business  growth.  Academic  researchers  agree,  in  general,  but 
with  warnings  that  the  effect  may  be  small  or  limited  to  special  circumstances. 
Some  observers  continue  to  argue  that  tax  incentives  are  counterproductive.  If 
there  is  a  general  consensus  on  the  effect  of  tax  policy  on  business  growth,  it  is 
limited  to  two  very  general  points: 

•  It  is  undesirable  (jfrom  the  perspective  of  development)  for  state 
taxes  to  be  very  far  out  of  line  with  those  of  neighboring  states,  and 

•  Policymakers  cannot  automatically  assume  that  tax  cuts  and  tax 
breaks  will  stimulate  growth  (Snell,  1998,  p.  8). 

Business  climate,  as  the  term  was  used  in  the  1980s,  was  gauged  by  low 
wages,  low  taxes,  and  minimal  regulatory  requirements  -  ideal  circumstances  for 
the  mass  production,  smokestack  industries  of  the  past.  An  obvious  flaw  in  such 
an  evaluation  was  that  the  states  that  met  these  standards  often  did  not,  in  fact, 
attract  much  development. 
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More  recent  studies  take  a  broader  view.  Financial  World,  in  its  November 
18,  1996  ranking  of  what  contributed  to  a  good  business  climate,  considered  such 
features  as  state  growth  rates,  poverty  rates,  business  closings,  educational 
attainments  in  the  work  force,  and  numbers  of  colleges  and  business  schools 
(Snell,  1998,  p.  43). 

Evaluating  economic  incentive  programs  can  help  determine  what  works 
(or  what  works  relatively  well)  and  what  does  not  (or  does  not  work  as  well  as 
other  programs).  Such  knowledge  would  help  state  policymakers  utilize  limited 
public  resources  in  the  most  effective  manner. 

B.  STATEMENT  OF  PROBLEM 

No  one  knows  much  about  the  effectiveness  of  economic  incentive 
programs  (Snell,  1998,  p.  53).  In  this  time  of  unprecedented  economic  growth, 
state  and  local  governments  are  faced  with  the  challenge  of  measuring  the 
effectiveness  of  devoting  valuable  resources  to  economic  development  programs 
to  create  a  good  business  climate. 

How  effective  these  programs  are  in  promoting  a  good  business  climate  is 
difficult  to  measure.  Most  state  evaluations  are  compliance  audits,  designed  to 
determine  whether  a  program  conforms  to  the  law  rather  than  to  measure 
effectiveness.  Academic  assessments  tend  to  focus  on  tax  policy  alone,  and  to 
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produce  results  that  offer  little  practical  advice  for  legislators.  Economic 
development  agencies  focus  on  their  successes,  but  not  on  evaluation  or  cost- 
effectiveness.  Stories  of  successes  and  failures  have  their  uses,  but  they  cannot 
answer  the  question  of  whether  this  would  have  happened  anyway. 

C.  RESEARCH  QUESTIONS 

The  primary  research  question  of  this  thesis  is:  What  are  the  essential 
characteristics  of  a  performance  evaluation  system  for  selected  IDED 
programs? 

Subsidiary  research  questions  supporting  this  issue  are: 

1.  What  are  the  challenges  to  performance  evaluation  of  public 
programs? 

2.  What  are  the  measures  of  success  for  economic  incentive  programs? 

3 .  What  are  appropriate  measures  of  performance? 

4.  Are  state  programs  evaluating  their  programs  with  appropriate 
measures? 

5.  Is  there  data  that  exists  to  support  an  appropriate  evaluation? 

D.  OBJECTIVE 

The  objective  of  this  project  is  to  determine  how  the  IDED  can  measure  the 
effectiveness  and  performance  of  selected  economic  incentive  programs.  It  will 
investigate  potential  methods  for  performance  evaluation  of  these  programs  and 
attempt  to  answer  the  question  of  how  to  evaluate  economic  incentive  programs. 
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E.  METHODOLOGY 


The  following  approach  will  be  used  during  this  study: 

1.  Identify  policy  and  program  evaluation  paradigms  within  the  public 
sector  performance  evaluation  literature. 

2.  Identify  the  key  IDED  programs  and  the  objectives  and  goals  of 
each. 

3.  Develop  performance  indicators  for  selected  IDED  programs. 

4.  Address  the  impact  of  the  proposed  evaluation  methodology  on  the 
current  IDED  programs. 

F.  ORGANIZATION  OF  STUDY 

Chapter  I,  Introduction,  will  present  the  focus  of  this  study.  It  will 
introduce  the  economic  incentive  programs  administered  by  the  IDED. 

Chapter  II,  Literature  Review,  will  present  the  purpose,  current  utilization, 
and  future  use  of  performance  measurement  in  government.  It  will  also  explore 
the  challenges  of  public  sector  performance  evaluation  and  conclude  with  a 
description  of  the  process  that  will  be  used  to  measure  the  effectiveness  of  the 
IDED  program. 

Chapter  III,  Methodology,  will  outline  the  research  methodology  used  to 
conduct  this  study. 

Chapter  IV,  Evaluating  IDED  Performance,  will  evaluate  the  program’s 
current  measures  of  effectiveness. 
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Chapter  V,  Analysis,  will  propose  various  performance  indicators  and 
measures  of  effectiveness  for  the  IDED  program. 

Chapter  VI,  Conclusion,  will  summarize  the  researcher’s  findings  and 
recommend  a  course  of  action  to  implement  an  IDED  performance  evaluation 
system. 
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II.  LITERATURE  REVIEW 


A.  PERFORMANCE  EVALUATION  IN  THE  PUBLIC  SECTOR 

This  thesis  will  draw  on  Todd  Calhoun’s  findings  about  the  challenges  of 
performance  evaluation  in  the  public  sector.  To  folly  understand  performance 
evaluation,  one  must  clearly  define  a  measurement  system,  differentiate  between 
process  and  results-oriented  systems,  recognize  the  purpose  and  need  for  a  system, 
and  appreciate  the  forces  affecting  its  application.  (Calhoun,  1998) 

1.  Purpose  of  Performance  Measurement 

Measurement  of  program  efficiency  involves  collecting  and  reporting  on 
input,  throughput,  and  output  factors  in  an  effort  to  improve  agency  processes. 
Assessing  the  effectiveness  of  a  program  requires  measuring  outcomes  against 
stated  objectives  (Calhoun,  1998).  Various  government  reports  and  private 
scholars  have  remarked  on  the  lack  of  results-oriented  measurement  in  government 
(Quade,  1984;  Greiner,  1996,  Halachmi/Bouckaert,  1996).  “Without  adequate 
measurement,  managers  and  employees  within  foe  agency,  other  agencies  and 
oversight  bodies,  interest  groups,  foe  public,  or  foe  courts  may  not  be  able  to 
document  changes  in  performance”  (Halachmi/Bouckaert,  1996,  p.  3).  Many 
reasons  have  been  proposed  for  this,  including  institutional,  technical,  and 
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financial  obstacles.  Many  practical  reasons  exist,  however,  for  implementing 
performance  measurement  systems  in  government  (Calhoun,  1998). 

There  is  a  spectrum  of  approaches  to  public  sector  performance  evaluation 
within  the  literature.  Anchoring  one  end  of  the  spectrum  is  the  “technically 
rational  paradigm”  that  presupposes  objectives  consensus  and  treats  performance 
measurement  as  a  coldly  objective  and  scientific  aid  to  decision-making.  On  the 
other  end  is  the  “politically  rational  paradigm”  that  recognizes  that  objective 
consensus,  when  it  exists,  is  a  result  of  political  bargaining  among  multiple 
stakeholders.  It  emphasizes  identifying  stakeholders  and  their  respective 
objectives  as  a  preliminary  step  in  the  performance  measurement  process. 
(Calhoun,  1998) 

2.  Problems  Associated  with  Public  Sector  Performance  Evaluation 

Performance  measurement  in  public  policy  is  more  easily  discussed  than 
implemented.  Public  sector  operations  possess  multiple  or  poorly  defined 
objectives,  lack  comparative  standards,  and  often  result  in  non-quantifiable 
outcomes.  Public  sector  performance  evaluation  cannot  be  completely  scientific. 
The  political  pressures  of  powerful  stakeholders,  the  lack  of  institutional  readiness, 
and  various  technical  obstacles  must  be  considered.  For  public  agencies  to  remain 
politically  viable  in  today’s  world  they  must  attempt  to  measure  the  effectiveness, 
or  outcomes,  of  their  programs.  (Calhoun,  1998) 
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The  difficulties  of  measuring  performance  have  been  well  documented  in 
the  current  literature  (Flynn,  1986,  1993;  Jackson  and  Palmer,  1992).  Regardless 
of  these  difficulties,  organizations  are  continually  challenged  to  demonstrate 
effective  performance  to  their  stakeholders.  The  desire  for  demonstrable 
performance  was  clearly  behind  the  Government  Performance  and  Results  Act 
(GPRA)  of  1993  (Public  Law  103-62).  This  law  requires  all  federal  agencies  to 
complete  a  strategic  plan  by  1996;  the  plan  must  be  based  on  outcomes  rather  than 
inputs  or  process  measures  (Bryson,  1995,  p.  30).  Several  states  have  initiated 
performance-oriented  planning  systems  as  well  (National  Governors  Association, 
1993).  “Budgeting  for  Results  is  a  part  of  Iowa’s  effort  to  respond  to  the  need  for 
government  fiscal  reform  and  accountability.”  (Budgeting  for  Results  Handbook, 
1997-1998) 

B.  ECONOMIC  DEVELOPMENT 

American  states  have  engaged  in  economic  development  for  more  than  200 
years;  and  for  practically  the  same  length  of  time  there  have  been  those  who  have 
argued  against  such  activities.  The  extraordinary  grant  and  incentives  packages 
that  some  states  have  provided  for  economic  development  have  drawn  attention  to 
this  issue  in  recent  years  (Snell,  1998,  p.  vii).  “It  is  tempting  to  put  the  term 
economic  development  in  quotes,  as  something  inherently  embarrassing.  It  should 
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be  embarrassing,  if  it  is  not...  Of  course,  no  firm  will  turn  down  gifts,  even  ones  of 
small  value,  and  any  firm  will  say  that  a  gift  will  persuade  it  to  do  nice  things.” 
(Kenyon,  1991,  p.  221) 

Individual  states  spend  millions  of  dollars  annually  on  economic 
development  programs.  Few  states  know  the  exact  amount  they  spend  to  support 
economic  development  initiatives.  No  state  knows  how  effectively  the  money  is 
spent  (Snell,  1998,  p.  1).  A  complete  list  of  state  activities  that  foster  economic 
development  would  include  almost  everything  funded  by  states.  Public  education, 
transportation,  public  safety,  and  administration  of  the  courts  are  essential  parts  of 
the  physical  and  social  infi'astructure  (Snell,  1998,  p.  6).  There  are  not  many  state 
and  local  government  activities  that  do  not  affect  their  economies,  for  good  or  for 
ill  (Kenyon,  1991,  p.  221).  The  major  types  of  recognized  economic  development 
measures  now  in  use  include:  capital  subsidies,  subsidies  of  other  inputs,  tax 
preferences,  enterprise  zones  and  promotion  of  the  state,  region,  or  city  as  a  good 
place  to  locate  or  visit  (Kenyon,  1991,  p.  224). 

1.  Capital  Subsidies 

a.  Grants  and  Direct  Payments 

Direct  grants  to  individuals,  corporations  or  other  types  of  businesses 
are  not  constitutionally  possible  in  every  state.  Where  they  can  exist,  they  offer 
the  advantage  of  great  flexibility.  They  can  include  detailed  reporting  and 
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compliance  requirements,  and  can  be  terminated  if  recipients  fail  to  meet  agreed 
upon  emplojmient  or  other  targets  (Snell,  1998,  p.  16). 

b.  Loans  and  Loan  Guarantees 

Most  states  have  created  a  variety  of  business-oriented  loan 
programs,  funded  by  bonds,  appropriations  and  federal  grants  (Snell,  1998,  p.  16). 
Some  of  the  major  categories  include:  industrial  development  bonds,  linked 
deposit  programs,  direct  loans,  loan  guarantees,  and  revolving  loan  funds. 

Industrial  development  bonds  (IDBs)  are  issued  by  state  and  local 
governments,  often  through  special  authorities  such  as  an  industrial  finance 
authority  or  a  department  of  commerce  (Snell,  1998,  pp.  16-17).  Linked  deposit 
programs  designate  a  portion  of  state  deposits  in  lending  institutions  to  help 
provide  low-cost  capital  for  specified  investments  in  the  state  (Snell,  1998,  p.  17). 
Direct  loan  programs  can  be  targeted  as  broadly  or  as  narrowly  and  specifically  as 
states  wish.  State  loan  programs  are  usually  limited  to  less  than  fifty  percent  of 
project  cost,  and  are  intended  to  encourage  private  lending  by  making  a  project 
more  attractive  to  the  private  sector  (Snell,  1998,  p.  19).  Loan  guarantees  ensure 
the  repayment  of  some  portion  of  a  loan  that  a  commercial  lender  has  made  to  an 
approved  firm.  State  programs  may  include  minimum  and  maximum  amounts, 
specify  or  limit  the  purposes  for  which  the  proceeds  of  the  guaranteed  loan  are 
used,  specify  ceilings  on  interest  rates,  and  require  nonfinancial  performance  from 
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the  borrower,  such  as  creation  of  a  specified  number  of  jobs  (Snell,  1998,  p.  20). 
Revolving  loan  funds  represent  a  funding  source  that  can  be  used  for  the  kinds  of 
lending  programs  previously  described.  The  program  consists  of  a  dedicated 
capital  fund  that  is  lent  to  finance  successive  projects  over  an  extended  period. 
Depending  on  the  design  of  the  program,  such  funding  can  be  used  for  loan 
guarantees,  fixed  asset  loans,  working  capital  loans,  housing  loans,  or  loans  to 
cover  short-term  start-up  costs. 

c.  Venture  Capital  Programs 

Venture  capital  programs  use  public  funds  to  provide  higji-risk 
capital  investment  to  bring  technologically  innovative  products  and  processes  to 
market  (Snell,  1998,  p.  18).  State  venture  capital  funding  was  used  extensively  in 
the  1980s;  activity  seems  to  have  declined  in  the  1990s.  The  effect  on  job  creation 
has  been  difficult  to  demonstrate,  and  the  high  risks  and  delayed  returns  of  venture 
capital  investments  have  made  them  less  appealing  to  elected  officials  (Snell, 
1998,  p.  19). 

2.  Subsidy  of  Other  Inputs 

This  category  includes  training  costs,  research  and  development  costs, 
marketing  and  promotion  costs  and  site  search  costs  (Kenyon,  1991,  p.  224). 
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3. 


Tax  Preferences 


Legislators  and  state  economic  development  personnel  usually  agree  that 
tax  incentives  foster  business  growth.  Academic  researchers  agree,  in  general,  but 
with  warnings  that  the  effect  may  be  small  or  limited  to  special  circumstances, 
such  as  competition  within  metropolitan  areas  that  cross  state  lines.  Some 
observers  continue  to  argue  that  tax  incentives  are  counterproductive.  Statistical 
and  econometric  studies  are  nearly  unanimous  in  concluding  that  state  and  local 
tax  incentives  fail  to  attract  business,  create  jobs,  or  enhance  state  economic 
performance  (Lynch,  1996,  p.  12).  If  there  is  a  general  consensus  on  the  issue  of 
state  tax  policy  on  business  growdi,  it  is  limited  to  two  very  general  points:  it  is 
undesirable  (from  the  perspective  of  development)  for  state  taxes  to  be  very  far  out 
of  line  with  those  of  neighboring  states,  and  polic3miakers  cannot  automatically 
assume  that  tax  cuts  and  tax  breaks  will  stimulate  growth  (Snell,  1998,  p.  9). 

0.  State  Tax  Provisions 

General  tax  policy  involves  tax  law  provisions  that  apply  to  everyone 
who  is  liable  for  a  tax,  not  to  exemptions,  deductions  or  credits  targeted  to 
particular  kinds  of  businesses  or  activities  (Snell,  1998,  p.  8).  State  business  taxes 
include  corporate  income  taxes,  franchise  taxes,  sales  and  excise  taxes,  and 
property  taxes.  Many  states  impose  specialized  taxes  on  certain  industries, 
particularly  insurance  companies,  banks  and  other  financial  companies. 
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telecommunications  businesses,  and  public  utilities.  Major  trends  in  recent  years 
have  been  to  reduce  the  highest  rates  for  income  taxes  and  to  exempt  machinery, 
tools,  and  materials  used  in  productive  processes  from  state  sales  taxes  (Snell, 
1998,  p.  9). 

b.  Targeted  Tax  Incentives 

Targeted  tax  incentives  are  intended  to  benefit  a  limited  number  of 
taxpayers  -  or  even  an  individual  taxpayer  -  to  encourage  some  specific  activity. 
State  governments  use  such  provisions  to  attract  major  projects  (Snell,  1998,  p. 
10).  Examples  in  recent  years  are  legislation  in  Alabama  to  benefit  Mercedes- 
Benz;  Minnesota  legislation  on  behalf  of  Northwest  Airlines;  Nebraska  legislation 
on  behalf  of  the  Union  Pacific  Railroad;  and  Virginia  tax  legislation  to  attract  a 
joint  IBM-Toshiba  facility  (Snell,  1998,  pp.  10-11).  The  argument  for  such 
targeted  tax  laws  is  that  they  allow  states  to  compete  in  a  national  or  global  market 
for  major  facilities.  The  arguments  against  targeted  tax  incentives  are  that  they  are 
inequitable  and  undermine  tax  law  uniformity.  They  will  not  provide 
compensatory  tax  revenue  in  the  short  run,  and  maybe  not  in  the  long  run.  They 
reduce  a  state’s  ability  to  provide  services  at  the  same  time  they  encourage  growth. 
They  may  create  a  competitive  disadvantage  for  companies  that  do  not  receive  the 
benefit.  Finally,  they  can  allow  companies  to  make  non-negotiable  demands  on 
state  government  (Snell,  1998,  p.  11). 
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General  Tax  Incentives 


c. 

General  tax  incentives  include  tax  abatements,  tax  credits,  and  tax 
increment  financing.  Tax  abatement  is  a  targeted  reduction  or  elimination  of  a 
firm’s  local  tax  bill  -  usually  the  property  tax  obligation.  Abatements  are  used  as  a 
tool  to  attract  businesses  or  industry  to  a  community  (Snell,  1998,  p.  13).  A  tax 
credit  is  deducted,  dollar  for  dollar,  against  the  tax  that  would  otherwise  be  owed. 
States  use  several  types  of  credits:  investment  tax  credits,  investor  tax  credits,  and 
job  creation  tax  credits  are  examples  (Snell,  1998,  pp.  13-14).  Tax  increment 
financing  (TIP)  uses  tax  revenue  growth  produced  by  an  increase  in  the  tax  base  of 
a  specified  area  to  repay  the  costs  of  investment  in  the  area.  Practices  vary  greatly, 
but  generally  allow  a  governing  body  to  create  TIFs  without  voter  consent  or  the 
consent  of  overlapping  jurisdictions  (Snell,  1998,  p.  15). 

4.  Enterprise  Zones 

An  enterprise  zone  is  specific,  limited  area  of  a  city  that  is  targeted  for 
redevelopment  on  the  basis  of  hi^  unemployment,  poverty,  aging  housing  stock, 
or  other  evidence  of  economic  weakness  (Snell,  1998,  p.  26).  A  variety  of 
incentives  are  usually  available,  normally  on  a  more  generous  basis  than  elsewhere 
in  the  state  or  city  (Kenyon,  1991,  p.  224). 
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5. 


State,  Region  or  City  Promotions 


States  provide  tax  and  other  incentives  to  travel-related  businesses  in 
addition  to  funding  advertising  to  attract  tourists.  State  tax  breaks  to  encourage 
commercial  movie  making  sometimes  augment  other  state  programs  to  encourage 
movie  and  television  film  production  (Snell,  1998,  pp.  39-40). 

C.  CHAPTER  SUMMARY 

Performance  measurement  in  public  programs  is  still  a  developing  issue.  In 
the  wake  of  GPRA,  government  agencies  at  all  levels  are  attempting  to  measure 
their  performance  more  effectively  in  order  to  convince  the  public  of  their 
necessity.  State  economic  development  programs  fall  into  this  difficult  area  of 
public  policy  measurement. 

One  of  the  main  difficulties  of  performance  measurement  of  these  programs 
is  the  political  nature  of  economic  incentives.  “Local  economic  development 
officials  have  every  reason  to  exaggerate  the  effectiveness  of  their  wares,  so  as  to 
assure  the  continuance  of  the  program  and  their  continuance  in  office.”  (Kenyon, 
1991,  p.  231)  A  competition  has  developed  through  these  various  incentives  to 
win  businesses  away  from  other  states.  Once  one  state  uses  economic 
development  incentives,  it  encourages  all  others  to  match  those  incentives;  the 
more  closely  the  better  (Kenyon,  1991,  p.  225).  Although  almost  any  state  policy 
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affects  its  economy,  several  economic  development  measures  have  been  developed 
solely  for  stimulating  the  local  economy.  The  measures  used  by  the  State  of  Iowa 
are  common  to  most  states. 
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ni.  METHODOLOGY 


A.  INTRODUCTION 

This  chapter  will  outline  the  methodology  used  to  conduct  this  study.  It 
will  describe  the  selected  research  focus  and  the  primary  research  methods  used. 
The  chapter  will  conclude  by  describing  the  methodology  Calhoun  used  to 
evaluate  public  sector  performance. 

B.  RESEARCH  FOCUS 

The  objective  of  this  thesis  is  to  help  the  Iowa  Department  of  Economic 
Development  (IDED)  determine  appropriate  measures  of  success  for  their 
economic  incentive  programs.  It  is  commonly  held  that  no  one  knows  much  about 
the  effectiveness  of  economic  incentive  programs.  Academic  assessments  have 
focused  primarily  on  tax  policy.  State  evaluations  are  generally  restricted  to 
compliance  audits.  The  economic  development  agencies  focus  on  their  successes 
and  not  on  evaluation  or  cost-effectiveness  (Snell,  1998,  p.  53).  However,  it  seems 
possible  to  objectively  measure  the  effectiveness  of  economic  incentive  programs. 

C.  RESEARCH  METHODS 

This  primary  research  method  is  collecting  data  through  unobtrusive 
measures,  specifically  archival  research. 
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1. 


Unobtrusive  Measures:  Public  Archival  Data 


Webb,  et  al.  (1966),  point  out  that  archival  sources  of  information  have 
been  widely  used  in  public  administration  research  for  many  years  (Webb, 
Campbell,  Schwartz,  and  Sechrest,  1966).  Archival  data  sources  include  written 
materials  from  public  and  private  records  (Yeager,  1989).  Archival  research 
examines  recorded  facts  (Buckley,  Buckley  and  Chiang,  1976,  p.  25).  The 
archival  data  collected  in  this  study  come  solely  from  public  records. 

Buckley,  Buckley  and  Chiang  distinguish  three  archival  domains:  (1) 
primary,  (2)  secondary,  and  (3)  physical.  The  first  two  deal  with  written  records, 
tapes  and  other  forms  of  documentation.  A  primary  archive  is  one  consisting  of 
original  documents  or  official  files  and  records  such  as  invoices,  purchase  orders 
or  receipts.  A  secondary  archive  publishes  data  gathered  by  other  investigators 
using  primary  documents.  Data  can  also  be  stored  in  the  physical  environment, 
such  as  footprints  in  the  snow  or  graffiti  on  a  wall  (Buckley,  Buckley  and  Chiang, 
1976,  p.  25). 

Secondary  public  sources  include  published  books,  articles,  studies,  papers, 
and  academic  lectures  (Yeager,  1989).  An  example  of  a  secondary  public  source 
is  the  Public  Administration  Review,  the  oldest  of  the  public  administration 
journals  (Yeager,  1989). 
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2. 


Deficiencies  in  Archival  Research 


Archival  sources  are  not  without  deficiencies.  The  major  deficiencies  are: 
(1)  selective  depositing,  (2)  selective  survival,  (3)  selective  retrieval,  (4)  “filling  in 
the  gaps,”  (5)  inherent  researcher  biases,  and  (6)  researcher  skill-deficiencies. 
Webb,  et  al.  (1966),  devote  Ihe  major  part  of  their  book  on  Unobtrusive  Measures 
to  the  opportunities  and  problems  associated  with  archival  research  (Buckley, 
Buckley  and  Chiang,  1976,  pp.  40-41).  While  these  problems  might  exist, 
particularly  with  individual  documents,  this  thesis  used  multiple  sources  to  ensure 
a  fair  picture  of  each  issue.  Agency-specific  sources  were  compared  to  reports 
from  other  agencies  or  to  similar  secondary  sources.  While  there  is  no  assurance 
that  archival  data  comprehensively  represent  all  the  stakeholders,  every  effort  was 
made  to  incorporate  archival  data  from  all  parties. 

D.  LEAKING  THE  PUBLIC  SECTOR  PERFORMANCE  MEASURE¬ 
MENT  PROCESS  TO  DATA  COLLECTION  AND  ANALYSIS 

The  methodology  Calhoun  used  to  evaluate  the  Expanded  International 
Military  Education  and  Training  (E-IMET)  program  is  applied  to  IDED.  The 
public  sector  performance  measurement  process  used  in  this  thesis  involves  four 
iterative  stages: 
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1 .  Identify  the  Key  IDED  Stakeholders; 

2.  Identify  the  Objectives  of  Iowa  Economic  Development  and  the 
IDED  Program; 

3.  Develop  Performance  Indices  for  the  IDED  Objectives; 

4.  Apply  technically  rational  performance  measurement  techniques. 

Step  #1  involves  collecting  secondary  archival  research  data.  Step  #2 
continues  collecting  archival  data  but  concludes  by  forming  a  Global  Objectives 
Hierarchy,  thus  moving  the  study  into  the  analysis  stage.  The  analysis  stage 
proposes  performance  indicators  for  the  IDED  program  objectives  and  depends 
heavily  on  data  gathered  through  secondary  archival  sources.  Step  #4,  actually 
measuring  program  performance,  is  beyond  the  scope  of  this  study.  Conclusions 
will  then  be  drawn  from  the  experiences  and  insight  gained  from  the  applying  the 
process  (Calhoun,  1998). 

E.  THE  PERFORMANCE  MEASUREMENT  PROCESS  AND  IDED 

1.  Step  #1:  Identifying  the  Key  IDED  Stakeholders 

The  purpose  of  this  step  is  to  identify  and  classify  the  key  stakeholders  of 
the  IDED  program.  This  process  will  involve  in  five  sequential  steps. 

First,  the  concept  of  a  stakeholder  will  be  clearly  defined  using  secondary 
archival  sources.  Internal  and  external  IDED  stakeholders  will  then  be  identified. 
Once  individual  stakeholders  have  been  identified,  they  will  be  grouped  according 
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to  the  stakes  they  share  in  evaluating  IDED  performance.  The  assumption  here  is 
that  individual  stakeholders  within  the  same  agency  share  common  views  on  IDED 
performance  evaluation  and  have  similar  effects  on  the  IDED  program.  This 
assumption  simplifies  the  analysis  to  remain  within  the  study’s  scope.  The  basis 
for  this  grouping  will  be  the  organizational  charts  found  in  the  secondary  archival 
sources. 

Each  group’s  stake  in  the  IDED  program  will  then  be  discussed,  to  better 
imderstand  the  effects  that  they  have  on  the  program’s  overall  objectives.  This  is  a 
very  subjective  step  and  will  be  based  on  agency-specific  documents.  The  last  step 
in  the  stakeholder  identification  process  is  to  formally  organize  the  various 
stakeholder  groups  into  a  “stakeholder  map.”  The  map  graphically  presents  the 
various  stakeholders  potentially  conflicting  effects  on  IDED  objectives  consensus. 
This,  too,  is  a  subjective  step,  but  will  be  based  on  agency-specific  documents. 

2.  Step  #2:  Identifying  the  Objectives  of  Iowa  Economic  Develop¬ 
ment  and  the  IDED  Program 

This  step  constructs  a  broad  Global  Economic  Development  Objectives 
Hierarchy  to  serve  as  a  basis  for  objective  performance  evaluation  and  to  link  the 
IDED  objectives  back  to  each  of  the  stakeholders.  This  process  will  take  place  in 
four  sequential  steps. 
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First,  each  stakeholder  group’s  economic  development  objectives  will  be 
outlined  using  official  agency-specific  documents.  Once  outlined,  a  subjective 
sifting  process  will  separate  objectives  from  strategies  (ends  versus  means) 
resulting  in  separate  agency-specific  objective  hierarchies.  A  Global  Objectives 
Hierarchy  will  then  be  constructed  using  common  stakeholder  objectives.  This 
Hierarchy  will  break  the  broad  governor  and  state  objectives  down  into  sub¬ 
objectives  and  specific  attributes  that  characterize  those  sub-objectives  using  the 
multiple  objectives  found  in  the  existing  individual  hierarchies.  While  this  process 
is  inherently  subjective,  it  is  more  a  function  of  pattern  recognition  amongst  the 
separate  stakeholder  hierarchies.  The  final  step  in  objective  identification  is  to  link 
the  specific  IDED  objectives  to  the  Global  Hierarchy.  This  last  step  forms  the 
logical  link  between  common  state  economic  development  objectives  and  the 
IDED  program. 

3.  Step  #3:  Developing  Performance  Indices  for  the  IDED  Objec¬ 
tives 

The  next  step  in  the  public  sector  performance  evaluation  process,  and  the 
purpose  of  the  last  step  in  this  study,  is  to  propose  performance  indicators  for  the 
IDED  program  objectives. 

This  is  the  most  critical  and  problematic  step  in  the  performance  evaluation 
process.  It  involves  identifying  the  qualities  inherent  in  each  of  the  objectives. 
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Quantifiable  performance  indicators  must  then  be  matched  to  specific 
characteristics  of  the  overall  objective.  In  short,  it  requires  understanding 
economics,  state  economic  policy  making,  and  resource  management.  These 
hierarchies  will  then  be  used  to  develop  performance  indicators  for  die  IDED 
program. 

It  is  important  to  note  that  the  result  of  the  process  is  simply  a  starting  point 
for  further  discussion.  The  indicators  found  in  this  study  will  he  developed  largely 
outside  the  influence  of  IDED  officials.  This  process  is  inherently  subjective  and 
must  be  combined  with  informed  IDED  data  to  yield  the  most  beneficial 
performance  measures. 

F.  CHAPTER  SUMMARY 

1.  The  Public  Sector  Performance  Evaluation  Process 

The  four-step  method  to  measure  public  sector  program  performance  is  an 
iterative  process  utilizing  data  gathered  through  archival  and  interview  research. 
While  every  effort  was  made  to  gather  data  that  is  representative,  adequate,  and 
reliable,  limitations  did  exist. 

2.  Limitations  of  the  Study 

The  chief  limitation  of  this  study  is  the  limited  past  efforts  to  measure  the 
effectiveness  of  economic  incentive  programs.  Testimony  to  the  Task  Force  on 
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Economic  Development  indicated  that  there  is  a  weak  coimection  between  cause 
and  effect  in  economic  development  work,  and  economic  development  agencies 
have  not  developed  effective  ways  to  monitor  their  own  performance  (Snell,  1998, 
p.  55).  There  is  no  standard  evaluation  format  for  economic  incentive  programs. 
This  is  why  Calhoun’s  methodology  was  adapted  for  this  evaluation. 

Another  study  limitation  was  the  limited  access  to  various  IDED 
stakeholders.  Time  and  distance  between  Iowa  and  California  precluded  many 
face  to  face  meetings. 
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IV.  EVALUATING  IDED 


A.  INTRODUCTION 

The  purpose  of  the  1993  Government  Performance  and  Results  Act  (GPRA) 
is  “to  improve  Federal  program  effectiveness  and  public  accountability  by 
promoting  a  new  focus  on  results,  service  quality,  and  customer  satisfaction” 
(GPRA,  1993,  p.  2).  This  act  has  initiated  a  fundamental  change  in  the  way 
government  agencies  at  all  levels  evaluate  themselves.  Budgeting  for  Results  is  a 
part  of  Iowa’s  effort  to  reform  government  and  improve  fiscal  accountability. 
Performance  management  and  Budgeting  for  Results  begin  by  defining  the 
stakeholders  and  customers  and  what  they  expect  from  state  programs  or  services 
(BFR  Handbook,  1997-1998).  It  is  essential  to  consider  the  various  stakeholders 
that  affect  the  agency  or  program  before  developing  a  set  of  overall  objectives. 

The  purpose  of  this  chapter  is  to  identify  the  stakeholders  of  the  IDED 
program.  Once  the  stakeholders  have  been  identified,  they  will  be  grouped 
according  to  similar  stakes  and  organized  into  an  IDED  stakeholder  map.  Chapter 
V  will  identify  the  economic  development  goals  (objectives)  of  each  stakeholder 
group  based  on  their  written  documentation,  i.e..  Budgeting  For  Results  and  the 
Iowa  Code.  The  IDED  objectives  provide  the  basis  for  developing  of  performance 
indicators  for  the  IDED  program. 
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B.  IDED  STAKEHOLDERS 


1.  Identification  of  Stakeholders 

Measuring  the  IDED  program  performance  must  begin  by  identifying  of 
key  stakeholders.  A  stakeholder  is  defined  as  any  person,  group,  or  organization 
that  can  claim  an  organization’s  attention,  resources,  or  output  or  is  affected  by 
that  output  (Bryson,  1995,  p.  27).  The  Iowa  State  government  defines  stakeholders 
as  everyone  who  has  a  vested  interest  in  the  service  provided,  and  in  the  quality, 
costs,  and  results  of  the  program  (BFR  Handbook,  1997-1998).  To  identify  key 
stakeholders,  Roberts  and  King  ask  the  question:  “What  are  the  key  stakeholder 
groups  that  are  affected  by  or  can  affect  the  policies  and  programs  which  you  are 
attempting  to  introduce?”  (Roberts  and  King,  1989,  p.  68). 

Descriptions  of  a  stakeholder  range  from  the  highly  specific  to  the  general 
(Clarke,  1998).  Stakeholders  can  be  either  internal  or  external  to  the  organization 
or  program  (Roberts  and  King,  1989).  They  can  also  be  potentially  hostile  or 
adversarial.  Any  group,  internal  or  external,  can  potentially  make  a  difference  to 
the  organization  or  program  (Roberts  and  King,  1989).  Once  identified,  individual 
stakeholders  are  grouped  according  to  similar  stakes  and  organized  into  an  overall 
“stakeholder  map”  (Roberts  and  King,  1989). 

The  first  step  in  a  stakeholder  analysis  is  to  identify  the  organization’s 
stakeholders  (Bryson,  1995,  p.  27).  The  presence  of  multiple  stakeholder  groups 
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may  result  in  diverse  or  conflicting  ideas  concerning  a  program’s  objectives. 
Thus,  carefully  identifying  dominant  stakeholders  is  the  critical  first  step  in 
defining  a  single  set  of  objectives  for  a  program  (Calhoun,  1998).  Figure  1  shows 
the  dominant  individual  stakeholders  for  the  IDED  program. 


Department  of  Revenue 
and  Finance 

Department  of  Commerce 


Coimcil  on  Human  Investment 


Department  of  Iowa 
Workforce  Development 


The  Governor 


Citizens 


House  Economic  Development 
Committee 

Senate  Small  Business,  Economic 
Development  &  Tourism  Committee 


The  House  Commerce  and  Regulation 
Committee 

Senate  Business  &  Labor  Committee 


IDED  Employees 

Communities 

Local  Governments 

Financial  Community 
Business  Commtmity 


Iowa  Commission  on  Interstate 
Cooperation 

House  Appropriations  Committee 


Senate  Appropriations  Committee 


Figure  1.  Individual  IDED  Program  Stakeholders 
2.  Stakeholder  Issues,  Concerns,  or  Stakes 

Once  the  key  stakeholders  have  been  identified  it  is  necessary  to  determine 
the  “stake”  each  has  in  E-IMET  effectiveness  evaluation.  According  to  Roberts 
and  King, 
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A  stake  is  the  claim  on  the  organization  that  each  stakeholder  has. 
The  concept  of  a  stake  is  based  on  the  idea  of  one’s  having 
something  to  lose  or  gain  in  a  given  situation,  and  therefore  the 
nature  of  the  stake  depends  on  the  issue  at  hand.  Thus,  the  stake  may 
be  tangible  (money,  material,  resources)  or  intangible  (time,  prestige, 
self-esteem),  explicit  or  implicit.  Moreover,  a  stake  may  be 
economic,  political,  social,  or  psychological  in  nature  (Roberts  and 
King,  1989,  p.  66). 


a.  The  Grouping  Process 

The  individual  stakeholders  will  be  placed  into  groups  to  simplify 
the  stakeholder  analysis.  Individual  stakeholders  that  are  organic  to  higher  level 
governmental  agencies  can  be  grouped  according  to  their  formal  organizational 
charts.  This  assumes  that  individual  stakeholders  under  operational  and 
administrative  control  of  their  higher-level  agency  will  possess  a  similar  stake  in 
the  IDED  program.  Other  stakeholders  will  be  grouped  according  to  related 
interests.  It  will  then  be  possible  to  characterize  the  stakes  of  each  group  and 
construct  an  overall  stakeholder  map.  The  following  stakeholder  groups,  along 
with  their  key  individual  stakeholders,  have  been  identified  for  this  study: 

The  Executive  Office  of  the  Governor  Group 
The  Governor 

The  Council  on  Human  Investment 
The  Department  of  Revenue  and  Finance 
The  Department  of  Commerce 
The  Department  of  Iowa  Workforce  Development 
IDED  Employees 
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The  Community  Group 


Citizens 
Communities 
Local  Governments 


The  Business  Community  Group 

The  Business  Community 
The  Financial  Community 


The  Legislative  Group 

The  House  Economic  Development  Committee 
The  Senate  Business  &  Labor  Committee 
The  House  Commerce  and  Regulation  Committee 
The  Senate  Small  Business,  Economic  Development  &  Tourism  Committee 
The  Senate  Appropriations  Committee 
The  House  Appropriations  Committee 
The  Iowa  Commission  on  Interstate  Cooperation 

b.  Stakes  Analysis 

The  following  describes  the  stakes  for  each  stakeholder  group.  It 
focuses  on  each  groups’  stands  role  in  IDED  performance  evaluation. 

(1)  The  Executive  Office  of  Governor  Group.  The 
Governor’s  state  policy  objectives  are  developed  through  the  Iowa  State 
Government’s  Enterprise  Strategic  Planning  Process.  This  process  brings  agency 
directors  together  in  Planning  Teams  to  develop  strategic  plans  for  each  enterprise 
to  implement  the  Governor’s  Leadership  Agenda.  The  Governor’s  Leadership 
Agenda  includes  goals,  strategies,  and  Governor’s  State  Policy  Objectives.  The 
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planning  teams  develop  a  vision  for  each  strategy  and  recommend  a  small  number 
of  Governor’s  State  Policy  Objectives  (BFR  Handbook,  1997-1998).  Each 
department  is  also  subject  to  the  Budgeting  for  Results  guidelines.  The  IDED 
employees  have  a  stake  in  demonstrating  the  effectiveness  of  IDED  in  order  to 
ensure  the  program’s  continued  existence. 

(2)  The  Community  Group.  Iowa  citizens  are  key 
stakeholders  in  the  IDED  program.  The  programs’  effects  are  either  directly  or 
indirectly  focused  on  Iowa  citizens.  The  use  of  their  tax  dollars  to  fund  these 
programs  should  also  be  of  primary  concern.  The  citizens’  concerns  are  captured 
through  public  surveys.  State  policy  objectives  are  developed  through  statistically 
valid  public  surveys  that  identify  what  is  important  to  lowans  (BFR  Handbook, 
1997-1998). 

(3)  The  Business  Community  Group.  The  business 
community  has  both  positive  and  negative  outcomes  from  the  IDED.  It  has 
members  that  benefit  from  IDED  and  others  who  may  feel  that  IDED  is  offering  an 
unfair  advantage  to  their  competitors.  The  financial  community  may  find  itself  in 
competition  against  IDED’s  low  interest  or  forgivable  loans. 

(4)  The  Legislative  Group.  The  legislature  establishes 
the  laws,  authorizes  the  programs,  appropriates  the  funds,  and  oversees  the  role 
that  economic  development  plays  in  state  affairs.  The  basic  legislative  stakeholder 
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organization  is  the  committee.  Traditionally,  powerful  Appropriation  Committees, 
as  well  as  their  respective  Subcommittees,  are  the  dominant  stakeholders.  These 
committees  provide  program  oversight  during  annual  hearings  on  fiscal  year 
spending. 

(5)  Summary.  Four  different  groups  of  stakeholders  have 
a  stake  in  IDED  performance  evaluation.  The  Executive  Office  of  the  Governor 
Group  has  a  political  stake  in  determining  whether  the  IDED  program  meets  the 
Governor’s  economic  development  priorities.  The  Community  Group  desires  a 
strong  economic  base  to  maintain  their  quality  of  life.  The  Business  Community 
Group  has  a  financial  interest  in  IDED.  The  Legislature  has  a  stake  in  the 
government-wide  adherence  to  the  Budgeting  for  Results  legislation.  The  people’s 
elected  representatives  want  to  prove  to  their  constituents  that  their  money  is  not 
being  wasted. 

C.  THE  STAKEHOLDER  MAP 

Based  on  their  different  stakes  in  evaluating  the  IDED  program,  the  various 
stakeholder  groups  can  finally  be  organized  into  an  overall  stakeholder  map. 
Figure  2  contains  the  IDED  stakeholder  map. 
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House  Economic 
Development  Committee 

Senate  Business  &  Labor 
Committee 

House  Appropriations 
Committee 

Senate  Appropriations 
Committee 

House  Commerce  & 
Regulation  Committee 

Senate  Small  Business, 
Economic  Development 
&  Tourism  Committee 

Iowa  Commission  on 
Interstate  Cooperation 


The  Community  Grouy 

Citizens 
Communities 
Local  Governments 


Figure  2.  The  IDED  Stakeholder  Map 
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V.  ANALYSIS 


A.  INTRODUCTION 

The  Iowa  Invests  legislation  of  1993  created  die  Council  on  Human 
Investment  which  was  charged  with  developing  and  implementing  performance 
management  for  the  Iowa  State  Government  (BFR  Handbook,  1997-1998). 
Government  usually  measures  its  efforts  in  terms  of  outputs  and  activities,  which 
does  little  to  gauge  the  impact  government  funded  efforts  have  on  lowans  (BFR 
Handbook,  1997-1998).  GPRA  emphasizes  setting  clear  program  goals  and 
measuring  program  performance  against  those  goals  (GPRA,  1993).  Developing  a 
clear  set  of  agreed-upon  program  goals  (objectives)  can  be  difficult  if  an 
organization  has  many  internal  and  external  stakeholders.  Each  stakeholder  may 
define  the  program’s  objectives  differently.  If  a  shared  definition  of  program 
objectives  does  not  exist,  then  any  attempt  to  objectively  measure  program 
performance  will  fail  as  multiple  constituencies  contend  over  whose  set  of 
objectives  will  serve  as  the  performance  baseline.  Thus,  it  is  necessary  to  analyze 
individual  stakeholder  objectives  in  order  to  determine  if  a  single  set  of  program 
objectives  exist. 

The  purpose  of  this  chapter  is  to  identify  each  stakeholder’s  economic 
development  objectives  to  determine  if  a  single  set  of  common  objectives  emerge. 
Using  written  documentation  from  each  group  of  stakeholders,  economic 
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development  objectives  were  singled-out  and  compared  to  other  stakeholder 
groups.  In  the  end,  a  single  set  of  economic  development  objectives  emerged  and 
was  arranged  into  a  “Global  Hierarchy.”  Specific  attributes  were  then  identified 
for  each  of  the  common  global  sub-objectives  and  used  to  link  the  IDED  programs 
back  to  the  Global  Hierarchy,  creating  an  objective  baseline  for  future  performance 
measurement  efforts. 

B.  THE  GLOBAL  HIERARCHY 
1.  Methodology 

This  section  will  present  the  logic  used  to  construct  the  Global  Hierarchy. 
It  will  outline  the  steps  in  the  process,  highlight  the  key  assumptions  that  were 
necessary,  and  examine  the  difficulties  encountered  during  the  process.  The 
section  will  include  a  Global  Objectives  Hierarchy  for  economic  development. 
a.  Step  #1:  Document  Review 

A  detailed  review  of  the  key  stakeholder  documents  that  contain  the 
stakeholder’s  economic  development  objectives  is  required  to  develop  a  Global 
Objectives  Hierarchy  for  economic  development.  Although  the  Executive  Branch 
sets  policy,  all  stakeholder  documents  should  be  used  to  form  the  Global 
Hierarchy.  However,  the  researcher  found  no  documents  to  represent  the  Business 
Community  Group’s  objectives.  The  following  stakeholder  documents  were 
analyzed: 
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Executive  Office  of  the  Governor  Group 

Budgeting  For  Results  Handbook  1997-1998 
Governor  Tom  Vilsack’s  Inaugural  Speech 
Governor’s  Budget  FY  00 

Building  Tomorrow’s  Workforce:  Iowa’s  Strategic  Plan 
IDED  Owner’s  Manual 

The  Community  Group 
Council  on  Human  Investment  poll  results 

Leeislative  Group 
Code  of  Iowa  1999 

Legislative  Guide  to  the  Iowa  General  Assembly 

The  preceding  list  of  documents  is  a  fair  representation  of  the  key 
documents  that  guide  stakeholder  economic  development  policy. 

b.  Step  #2:  The  Sifting  Process 

Once  the  key  stakeholder  documents  were  chosen,  a  sifting  process 
separated  economic  development  objectives  from  other  unrelated  objectives  for 
each  stakeholder  group.  Although  this  process  is  largely  subjective,  many  of  the 
documents  clearly  identified  objectives  as  being  economic  development  related. 

The  final  step  compared  economic  development  objectives  among 
the  stakeholder  groups  to  determine  if  objectives  consensus  existed.  Objectives 
consensus  is  the  foimdation  for  the  Global  Hierarchy  and  the  key  prerequisite  for 
objective  performance  evaluation  (Calhoun,  1998). 
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(1)  Sifting  Process  Challenges.  Extracting  the  few  specific 
economic  development  objectives  from  the  key  stakeholder  documents  was  a  difficult 
and  highly  subjective  process.  Three  specific  difficulties  were  encountered  during  the 
sifting  process. 

(a)  Objectives  for  Everything.  A  common  problem  found  in  the  key 
stakeholder  documents  was  the  exhaustive  list  of  objectives  to  be 
accomplished.  The  State  policy  objectives  found  in  the  BFR 
Handbook  set  nearly  all  possible  positive  outcomes  as  objectives. 
Many  of  the  stakeholder  documents  highlighted  a  broad  objective 
that  could  have  numerous  interpretations. 

(b)  Practice  in  Constructing  a  Global  Hierarchy.  As  Calhoun 
discovered,  “constructing  a  global  security  assistance  hierarchy 
proved  to  be  an  original  exercise,”  so  did  constructing  a  global 
economic  development  hierarchy.  No  documentation  from  any  of 
the  stakeholder  agencies  contained  any  previous  effort  to  link 
economic  development  program  objectives  using  a  Global 
Hierarchy.  The  lack  of  documentation  concerning  a  global  economic 
development  Objectives  Hierarchy  created  a  significant  challenge. 

c.  Step  #3:  Constructing  the  Global  Hierarchy 
The  next  step  is  to  actually  construct  the  Global  Hierarchy.  The 
existence  of  objective  consensus  among  the  individual  stakeholders  is  vital  to 
constructing  an  objectives  hierarchy.  Eventually,  there  emerged  a  consensus  of 
some  very  broad  economic  development  objectives  among  stakeholders. 

Two  simple  criteria  were  used  to  select  the  individual  stakeholder 
objectives  and  specific  attributes  that  would  be  incorporated  into  the  Global 
Hierarchy.  First,  the  stated  objective  had  to  fit  the  definition  of  an  “end.”  In  other 
words,  to  qualify  as  an  objective  it  could  not  be  interpreted  as  “means,”  or  an 
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alternative.  It  must  be  a  clear  statement  of  the  final  result  desired,  not  a  method  to 
get  there.  Second,  the  objective  had  to  directly  or  indirectly  relate  to  economic 
development.  This  requirement  is  purposefully  subjective  and  broad  to  recognize 
that  economic  development  takes  many  forms  and  is  related  to  many  objectives. 

The  broad  economic  development  objectives  of  strengthen  the 
economy,  diversify  the  economy,  and  improve  the  economic  well  being  and 
quality  of  life  of  all  lowans  came  primarily  out  of  the  Governor’s  Budget  and  the 
State  Policy  Objectives.  Figure  3  displays  the  final  Global  Objectives  Hierarchy. 

d.  Step  #4:  Validation 

Ideally,  the  resulting  Global  Hierarchy,  and  the  criteria  used  to  select 
the  sub-objectives  and  specific  attributes,  should  be  validated  through  an  interview 
process  with  various  stakeholders.  The  thesis  scope,  time  constraints,  and 
geographic  considerations  precluded  completing  this  step. 

2.  Linking  the  IDED  Program  Objectives  to  the  Global  Hierarchy 
Once  the  Global  Hierarchy  was  constructed  and  specific  attributes  were 
identified  the  next  logical  step  was  to  link  the  specific  IDED  program  objectives 
back  to  the  hierarchy.  If  an  IDED  objective  could  be  logically  linked  to  the 
achievement  of  a  specific  attribute  within  the  Global  Hierarchy  then  that  program 
was  placed  with  that  attribute.  Figure  3  demonstrates  how  the  programs  are  linked 
to  the  global  hierarchy. 


45 


Enhance  State  Economic  Development 


s 

Economy 
l^nt  Business)  1 

Uih 


Promote  economic 
growth  and  jobs  in 
all  regions  of  the 
state,  including 
rural  Iowa 


Increase  the  growth 
of  business  and 
industry  in  Iowa 


Make  Iowa  the 
food  capital  of  the 
world  ys. 


Provide  additional 
support  for 
agricultural 
marketing  J  ^ 


Stimulate  the 
growth  of 
existing 
businesses 
and 

encourage 

new 

businesses 
that  add 
value  through 
the 

processing  of 

agricultural 

commodities 


KEY: 

D 

Ultimate 

Economic 

Development 

Objective 

0 

Sub- 

Objectives 

D 

Additional 

Objectives 

Increase  the 

agricultural 

commodities 

processed  into 

consumer 

products  by 

Iowa 


Increase  the 
variety  of 
services, 
manufacturing, 
agriculture,  and 
industries  in 
the  state 


Improve  Ec^^ 

Well  Being  and  .  ^ 

of  Life  of  All 


Attract  and  retain 

L  the  quality 
j workforce 
necessary  for 

Iowa’s  future 

1 

Sincrease  the 

J  number  of  jobs 
that  pay  higher 
wages 

Expand  the 
skilled  workforce 
by  providing 
every  Iowan  the 
opportunity  to 
obtain  the  skills 
necessary  to 
succeed 


BDED  Objectives  Link  to  Global  Hierarch 


1)  Retain  or  Create  Quality  Employment 
Opportunities 

2)  Develop  New  or  Innovative  Products 
or  Processes  for  Iowa  Agricultural 
Commodities 

3)  Encourage  Business  Creation  or 
Expansion 


Figure  3.  Economic  Development  Objectives:  The  Global  Hierarchy 
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Because  performance  measurement  systems  do  not  yet  exist  within  the 
IDED,  any  attempt  to  link  selected  IDED  program  objectives  back  to  the  Global 
Objectives  Hierarchy  is  largely  subjective.  Quantitative  data  needs  to  be  collected 
that  objectively  concludes  that  IDED  programs  have  achieved  higher  global 
objectives. 

C.  INDICATORS  OF  PERFORMANCE 

The  third  step  in  the  public  sector  performance  evaluation  process  is 
developing  performance  indices  for  each  program  objective.  The  IDED  programs 
were  categorized  according  to  their  objectives  as  follows: 

1 .  Retain  or  create  quality  employment  opportunities 

Community  Economic  Betterment  Accoimt 
Economic  Development  Set-Aside  Program 

2.  Develop  New  or  Innovative  Products  or  Processes  for  Iowa 
Agricultural  Commodities 

Value-Added  Agricultural  Products  and  Processes  Financial 
Assistance  Program 

3.  Encourage  business  creation  or  expansion 

Entrepreneurial  Ventures  Assistance 

Targeted  Small  Business  Financial  Assistance  Program 

Self-Employment  Loan  Program 

Entrepreneurs  with  Disabilities 

Iowa  Capital  Corporation 

Enterprise  Zones 

Tax  Increment  Financing 

The  Infrastructure  Financial  Assistance  Programs  are  not  considered  a 
direct  economic  incentive  program. 
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In  order  to  evaluate  whether  various  IDED  programs  are  having  the  desired 
effect  results  must  be  measured  against  the  original  objectives.  This  section  will 
attempt  to  identify  specific  performance  indicators  that  can  be  used  to  evaluate  the 
effectiveness  of  the  IDED  programs  and  highlight  the  key  difficulties  encountered 
in  the  process. 

The  indices  proposed  in  this  section  are  developed  fi*om  the  data  collected 
through  secondary  archival  research.  This  section  is  not  meant  to  be  an  exhaustive 
list  of  IDED  performance  indices,  but  rather  a  starting  point  for  future 
development. 

1.  The  Importance  of  a  Baseline  Assessment 

The  performance  evaluation  process  essentially  compares  post-intervention 
results  against  objective  data  gathered  during  a  baseline  assessment  (Calhoun, 
1998).  A  baseline  assessment  is  defined  as  the  “initial  collection  of  data  to 
establish  a  basis  for  comparison”  (National  Performance  Review,  1997,  p.27).  The 
success  of  the  IDED  performance  evaluation  process  hinges  on  the  objective  initial 
assessment  of  Iowa’s  workforce  and  economic  conditions.  If  one  does  not  possess 
a  clear  understanding  of  economic  conditions  within  the  state  before  a  specific 
program  is  initiated,  attributing  future  incremental  changes  to  the  IDED  program  is 
not  possible.  All  program  results  must  therefore  be  stated  in  terms  of  a 
progression  away  fi'om  the  baseline  assessment. 
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Another  difficult  task  in  measuring  program  performance  against  the 
baseline  is  discerning  the  influence  of  external  factors  on  the  changes  from  the 
baseline.  Many  external  factors  could  affect  the  economy  and  unjustifiably  reflect 
either  negatively  or  positively  on  program  performance.  It  is  important  to  account 
for  external  factors,  such  as  a  strike,  drought,  or  general  economic  boom  is 
required  to  effectively  utilize  and  understand  the  data  gained  by  analyzing  changes 
from  the  baseline. 

The  performance  indices  proposed  in  this  chapter  assume  that  IDED  staff 
conducted  an  objective  baseline  assessment  before  specific  programs  were 
initiated.  The  design  and  implementation  of  an  IDED  performance  evaluation 
baseline  assessment  is  beyond  the  scope  of  this  study,  but  its  importance  within  the 
performance  evaluation  process  should  not  be  ignored.  Furthermore,  developing 
procedures  to  account  for  external  influences  is  also  beyond  the  scope  of  this 
thesis. 

2.  Problems  Associated  with  Performance  Indicators 

Halachmi  and  Bouckaert  categorized  thirteen  “measurement  diseases.”  A 
disease  being  “a  dysfunctional  effect  for  an  organization  or  its  environment  caused 
by  the  activity  and/or  assumptions  of  measuring  the  organizational  situation” 
(Halachmi/Bouckaert,  1995,  p388).  The  first  three  diseases,  the  Pangloss  disease, 
the  impossibility  disease,  and  hypochondria;  are  about  assumptions  and 
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convictions  that  harm  the  activity  or  measurement  itself.  The  remaining  ten 
diseases  are  about  the  measurement  activities  themselves.  Four  of  these,  the 
convex/concave  disease,  hypertrophy  disease,  atrophy  disease,  and  Mandelbrot 
disease;  involve  the  numbers  and  volumes  perceived.  Six  concern  the  content, 
position,  and  amount  of  measures;  these  include  the  pollution  disease,  inflation 
disease,  enlightened  top-bottom  disease,  time-shortening  disease,  mirage  disease, 
and  shifting  disease.  These  diseases  show  how  the  practice  of  measurement  can 
affect  the  functioning  of  an  organization.  The  following  briefly  defines  each 
disease: 

•  The  Pangloss  Disease  reflects  the  conviction  that  there  is  no  need  for 
productivity  measurement  because  there  is  no  inefficiency  problem 
in  government.  In  wake  of  GPRA  and  Budgeting  for  Results  this 
belief  has  probably  been  overcome. 

•  The  Impossibility  Disease  is  the  conviction  of  the  impossibility  of 
the  ability  to  conduct  measurement  itself  in  the  public  sector. 

•  Hypochondria  is  the  feeling  that  the  public  sector  has  to  be  worse 
than  the  private  sector. 

•  The  Convex/Concave  Disease  is  diagnosed  when  measuring  a 
process  component  result  in  a  measured  output  different  fi-om  the 
“real”  output  volume.  The  convex  disease  causes  a  higher-volume 
value  and  the  concave  a  lower-volume  value,  whereas,  in  reality  the 
opposite  is  true. 

•  The  Hypertrophy  Disease  causes  the  measurement  process  to 
actually  stimulate  the  production  of  real  output. 

•  The  Atrophy  Disease  causes  the  measurement  process  to  actually 
reduce  the  output  volume  or  certain  aspects  of  the  output. 
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•  The  Mandelbrot  Disease  results  when  utilizing  a  more  detailed 
measuring  device  causes  an  increase  in  perceived  amounts.  The 
higher  die  intensity  of  measurement,  the  higher  the  perceived  ou^ut. 

•  The  Pollution  Disease  is  caused  by  mixing  up  input,  activities,  output 
quantity,  output  quality,  and  effects.  Confusing  outputs  and  effects, 
or  outputs  and  quality,  is  common  and  makes  outputs,  effects,  and 
quality  less  visible. 

•  The  Inflation  Disease  involves  a  series  of  measures.  The  problem 
occurs  when  there  is  a  mushrooming  of  measures  in  the  agency.  The 
measurement  process  requires  an  exhaustive  information  system  that 
is  costly  and  time  consuming.  The  more  measures  that  are  available, 
the  more  likely  that  there  are  contradictory  measures. 

•  The  Enlightened  Top-Bottom  Disease  involves  measures  introduced 
from  outside  and/or  from  the  top  of  the  organization  and  imposed  on 
the  rest  of  the  organization. 

•  The  Time-Shortening  Disease  makes  the  organization  focus  on  the 
short  run  instead  of  on  the  intermediate  or  long  run. 

•  The  Mirage  Disease  shows  something  different  from  what  is  thought 
or  perceived.  The  use  of  indicators  in  the  place  of  measures 
produces  measurement  noise  that  may  make  us  hear  something 
different  from  what  we  think  or  hear. 

•  The  Shifting  Disease  affects  measures  that  do  not  match  the  goals  or 
purposes  of  the  organization.  Because  of  the  measure,  activities 
move  away  the  intended  activities  and  outputs  (Halachmi/Bouckaert, 
1995,  pp388-406). 

3.  Indicators  of  Performance  for  the  IDED 

a.  Retain  Or  Create  Quality  Employment  Opportunities 
The  first  IDED  objective  is  retaining  or  creating  quality  employment 
opportunities  for  lowans.  In  order  to  propose  performance  indicators  for  this 
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objective  one  must  define  the  specifics  of  quality  employment  opportunities. 
Unfortunately,  this  can  be  a  highly  subjective  definition. 

(1)  Quality  of  Employment.  Numerous  factors  could  be  included 
to  evaluate  the  quality  of  a  job.  These  factors  include  wage  rates,  comprehensiveness  of 
benefits  package,  career  orientation  and  whether  it  is  a  full  time  position.  After  getting 
past  wage  rates  and  benefits,  evaluating  employment  quality  is  largely  subjective. 

Personal  preferences  towards  job  location  and  environment 
have  a  strong  influence  on  perceived  employment  quality.  If  everyone  has  an 
individual  standard  for  these  things  then  there  is  obviously  no  overall  standard  that 
can  be  applied.  If  we  assume  that  everyone  enjoys  higher  wages,  increased 
benefits,  and  possibilities  for  advancement  then  we  can  include  these  in  an  overall 
standard. 

(2)  Quality  of  Employment  Objectives  Hierarchy  and  Performance 
Indices.  In  order  to  develop  performance  indices  for  employment  quality,  the  broad 
objective  of  create  or  retain  quality  employment  is  broken  down  into  sub-objectives  and 
specific  attributes.  The  goal  of  this  process  is  to  construct  a  quality  employment 
opportunity  objectives  hierarchy  that  can  be  used  to  identify  subsequent  performance 
indicators.  Figure  4  displays  the  Retain  or  Create  Quality  Employment  Objectives 
Hierarchy. 
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Sub-Objective  #1: 

Assisted  Businesses  Create  or  Retain  Quality  Employment  Opportunities 

Sub-Objective  #2: 

Assisted  Businesses  Employment  Opportunities  have  Career  Progressions 

Sub-Objective  #3: 

Assist  Individual  Skill  Development  and  Equate  to  Industry  Needs 

Specific  attributes  that  describe  each  sub-objective  can  then  be 
identified.  Based  on  the  specific  attribute,  indicators  of  performance  will  be 
proposed  that  can  be  used  to  support  whether  the  IDED  program  is  achieving  its 
stated  objective.  The  specific  attributes  of  each  sub-objective,  along  with  their 
respective  indicators  of  performance,  follow. 

Sub-Objective  #1: 

Assisted  Businesses  Create  or  Retain  Quality  Employment  Opportunities 

Specific  Attributes: 

1 .  The  wage  rate  is  competitive. 

Indicators  of Performance: 

•  The  wage  rate  is  greater  than  or  equal  to  the  median  county  wage 
rate. 

•  The  wage  rate  includes  cost  of  living  adjustments. 

•  Impact  on  competitors. 
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2.  Benefits  are  competitive. 

Indicators  of  Performance: 

•  Benefits  package  provides  full  medical  coverage. 

•  Benefits  are  equal  to  or  greater  than  median  value  for  county. 

•  Impact  on  competitors. 

3.  Create  or  retain  jobs. 

Indicators  of  Performance: 

•  Number  of  jobs  created. 

•  Number  of  jobs  retained. 

Sub-Objective  #2: 

Assisted  Businesses  Employment  Opportunities  have  Career  Progressions 

Specific  Attributes: 

1 .  Entry  level  positions  have  career  advancement  progression. 
Indicators  of Performance: 

•  Position  is  full  time. 

•  Position  has  defined  skill  levels. 

•  Position  has  defined  requirements  for  advancement. 

Sub-Objective  #3: 

Assist  Individual  Skill  Development  and  Match  to  Industry  Needs 
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Specific  Attributes: 


1 .  Provide  skill  training  to  individuals. 

Indicators  of  Performance: 

•  Number  of  individuals  trained. 

•  Number  and  type  of  skills  that  are  available  for  training 

2.  Determine  industry  skill  needs. 

Indicators  of  Performance: 

•  Number  of  new  skills  required  by  industry. 

•  Types  of  new  skills  required  by  industry. 

b.  Develop  New  or  Innovative  Products  or  Processes  for  Iowa 

Agricultural  Commodities 

(1)  Agricultural  Products  or  Processes.  In  1996,  gross  sales  for 
the  entire  Iowa  agricultural  system  were  $55.8  billion.  Agriculture  contributed  25.6 
percent  of  the  state’s  total  gross  state  product.  Agriculture  certainly  remains  at  the  heart 
of  Iowa’s  economic  future.  However,  the  cyclical  nature  of  the  industry  makes  strategic 
planning  difficult. 

Developing  new  products  and  processes  is  a  difficult  area  to 
measure  in  any  business.  Research  and  development  requires  a  great  deal  of 
experimentation.  If  every  lead  is  evaluated  then  precious  resources  may  be 
wasted,  especially  financial  ones.  If  too  few  resources  are  committed  then  a 
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striking  new  advancement  may  be  missed.  This  is  the  challenge  in  funding  and 
measuring  the  success  of  research  and  development  projects. 

(2)  New  or  Iimovative  Agricultural  Products  or  Processes 
Objectives  Hierarchy  and  Performance  Indices.  No  sub-objectives  were  developed 
for  this  objective.  Figure  5  displays  the  New  or  Innovative  Agricultural  Products 
or  Processes  Objectives  Hierarchy.  The  following  attributes  were  developed  from 
the  objective: 

Specific  Attributes: 

1.  Assist  Businesses  that  Develop  New  Agricultural  Products  or 
Processes 

Indicators  of Performance: 

•  Number  of  new  agricultural  products  or  processes  proposed 

•  Number  of  new  agricultural  products  or  processes  developed 

2.  Coordinate  with  Public  Research  Facilities  to  Develop  New 
Agricultural  Products  or  Processes 

Indicators  of  Performance: 

•  Number  of  agricultural  research  programs  established  at  public 
universities 

•  Number  of  private  businesses  with  links  to  public  agricultural 
research  facilities 
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•  Number  of  private  businesses  with  private  agricultural  research 
facilities 


Develop  New  or 
Innovative  Products 
or  Processes  for  Iowa 
Agricultural 
Commodities 


Assist  Businesses 
That  Develop 
New  Agricultural 
Products  or 
Processes 

Coordinate  with 
Public  Research 
Facilities  to 
Develop  New 
Agricultural 
Products  or 
Processes 

Figure  5.  New  or  Innovative  Agricultural  Products  or  Processes  Objectives 
Hierarchy 
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c.  Encourage  Business  Creation  or  Expansion 
The  third  IDED  objective  is  encouraging  business  creation  or 
expansion  within  the  state.  Providing  assistance  to  existing  businesses  is  a  much 
less  risky  proposition  than  assisting  a  new  business.  The  majority  of  businesses 
assisted  by  IDED  are  existing  businesses  undertaking  an  expansion. 

(1)  Encouraging  Business  Creation  or  Expansion.  Encouraging 
new  business  creation  or  expansion  is  one  of  the  most  criticized  areas  in  economic 
development.  The  government  is  no  better  than  the  private  sector  at  picking  the  winners 
and  losers  in  the  economy.  IDED  must  select  specific  businesses  that  it  will  assist.  With 
every  investment  comes  the  risk  of  failure.  Some  would  argue  that  this  is  not  the  place 
for  the  government  to  be  gambling  with  taxpayer  money.  Still,  it  is  the  primary  way  to 
target  an  industry  segment  for  development. 

(2)  Encouraging  Business  Creation  or  Expansion  Objectives 
Hierarchy  and  Performance  Indices.  Figure  6  displays  the  Encouraging  Business 
Creation  or  Expansion  Objectives  Hierarchy. 
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The  IDED  objective  of  encouraging  business  creation  or 
expansion  can  be  broken  down  into  the  following  sub-objectives: 

Sub-Objective  #1: 

Assist  Expanding  Businesses 
Sub-Objective  #2: 

Assist  New  Business  Creation 
The  following  specific  attributes,  along  widi  their  respective 
indicators  of  performance,  have  been  identified  for  the  sub-objectives  of 
encouraging  business  creation  or  expansion: 

Sub-Objective  #1: 

Assist  Expanding  Businesses 
Specific  Attributes: 

1.  Business  expansion  creates  positive  impact  on  local  economy. 

Indicators  of Performance 

•  Number  of  new  jobs  created 

•  Wage  paid  is  greater  than  the  median  city/county  wage 

•  The  expansion  did  not  result  in  the  business  closing  operations 
elsewhere  in  the  state 

2.  Assisted  businesses  remain  profitable  after  mandatory  requirements 
have  been  met. 
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Indicators  of  Performance 


•  After  all  mandatory  requirements  have  been  met,  the  businesses  ROI 
remains  competitive  with  industry 

•  After  all  mandatory  requirements  have  been  met,  the  number  of  jobs 
remains  the  same  or  increases 

Sub-Objective  #2: 

Assist  New  Business  Creation 

Specific  Attributes: 

1 .  Business  creation  creates  positive  impact  on  local  economy. 

Indicators  of  Performance 

•  Number  of  new  jobs  created 

•  Wage  paid  is  greater  than  the  median  city/county  wage 

•  Survival  rate  of  new  businesses  assisted  by  IDED  vs.  unassisted 

2.  New  business  owners  have  access  to  business  training. 

Indicators  of  Performance 

•  Number  of  programs  offering  business  skill  training 

•  Number  of  people  enrolled  in  business  skill  training 

d.  Indicators  of  Performance  Limitations 

The  performance  indicators  mentioned  above  are  examples  of  how 
one  would  formulate  performance  indicators  based  on  a  stated  objective.  They  are 
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certainly  not  all  encompassing  and  would  require  refinement  to  fit  any  particular 
economic  incentive  program. 

D.  THE  BALANCED  SCORECARD 

Collecting  data  on  every  indicator  will  likely  be  time  consuming,  expensive, 
and  overwhelming  for  the  EDED  manager.  Program  managers  must  choose  a 
handful  of  indicators  to  apply  to  their  specific  program.  The  “balanced  scorecard” 
format  developed  by  Kaplan  and  Norton  is  a  user-friendly  manner  in  which  to 
present  the  various  indicators  of  performance  for  each  IDED  objective. 

1.  The  Kaplan/Norton  Balanced  Scorecard 

After  a  year-long  research  project  with  twelve  companies  at  the  leading 

edge  of  performance  measurement,  Kaplan  and  Norton  devised  a  ‘balanced 

scorecard’ — set  of  measures  that  gives  top  managers  a  fast  but  comprehensive 

view  of  the  business”  (Dyson  and  O’Brien,  1998,  p.  55).  Kaplan  and  Norton 

developed  the  Balanced  Scorecard  after  realizing  that  senior  private  sector 

executives  do  not  rely  on  only  one  set  of  performance  measures  to  the  exclusion  of 

another  (Kaplan  and  Norton,  1992). 

No  single  measure  can  provide  a  clear  performance  target  or  focus 
attention  on  the  critical  areas  of  the  business.  Managers  want  a 
balanced  presentation  of  both  financial  and  operational  measures 
(Kaplan  and  Norton,  1992,  p.  71). 
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Think  of  the  Balanced  Scorecard  as  the  dials  and  indicators  in  an 
airplane  cockpit.  For  the  complex  task  of  navigating  and  flying  an 
airplane,  pilots  need  detailed  information  about  many  aspects  of  the 
flight.  [They  need]  indicators  that  summarize  the  current  and 
predicted  environment  (Kaplan  and  Norton,  1992,  p.  72). 

The  balanced  scorecard  allows  managers  to  look  at  flie  business  from  four 

important  perspectives:  (1)  How  do  customers  see  us?  (customer  perspective);  (2) 

What  must  we  excel  at?  (internal  perspective);  (3)  Can  we  continue  to  improve  and 

create  value?  (innovation  and  learning  perspective);  and  (4)  How  do  we  look  to 

shareholders?  (financial  perspective)  (Dyson  and  O’Brien,  1998,  p.  56).  Private 

sector  managers  realize  that  they  carmot  absorb  the  information  generated  by  every 

conceivable  measure  of  performance.  “The  Balanced  Scorecard  brings  together,  in 

a  single  management  report,  many  of  the  seemingly  disparate  elements  of  a 

company’s  competitive  agenda”  (Kaplan  and  Norton,  1992,  p.  73).  By  selecting 

three  to  four  key  measures  within  each  business  objective  managers  can  link  a 

wide  range  of  performance  measurement  data  allowing  them  to  make  better 

decisions  in  a  time  critical  environment.  The  format  of  the  Kaplan/Norton 

Balanced  Scorecard,  as  well  as  their  private  sector  example  of  an  electronics 

company,  can  be  found  in  Figure  7. 
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Format: 


Perspective 

Goals 

Measures 

' 

Balanced  Business  Scorecard  Example 


Figure  7.  Elaplan/Norton  Balanced  Scorecard  Format  and  Example 
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2. 


The  IDED  Balanced  Scorecard 


While  Kaplan  and  Norton  use  the  Balanced  Scorecard  to  present  financial 
and  operational  data  for  private  sector  firms,  managers  of  public  sector  programs 
with  multiple  objectives  can  apply  the  balanced  scorecard.  The  Kaplan/Norton 
Balanced  Scorecard  format  can  be  modified  so  that  chosen  performance  indicators 
are  listed  alongside  their  respective  sub-objective  for  each  of  the  IDED  objectives. 
These  modified  scorecards  can  serve  as  comprehensive  management  tools  for 
tracking  achievement  for  each  IDED  objective  within  a  given  coimtry.  The 
Kaplan/Norton  private  sector  Balanced  Scorecard  thus  becomes  the  “(IDED 
Program)  Balanced  Scorecard.” 

Deciding  what  indicators  of  performance  are  most  meaningful  for  an 
individual  program  is  a  subjective  process.  The  program’s  managers  should  make 
these  decisions. 

A  complete  “(IDED  Program)  Balanced  Scorecard”  example  can  be  found 
in  Figure  8. 
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RETAIN  OR  CREATE  QUALITY 
EMPLOYMENT  OPPORTUNITIES 

Sub-Objective 

Indicators  of  Performance 

Assisted 
Businesses 
Create  or 
Retain 

Quality 

Employment 

Opportunities 

Competitive  Wage  Rate 
Competitive  Benefits 
Package 

Job  Creation 

Job  Retention 

DEVELOP  NEW  OR  INNOVATIVE 
PRODUCTS  OR  PROCESSES  FOR  IOWA 
AGRICULTURAL  COMMODITIES 

Sub-Objective 

Indicators  of  Performance 

Develop  New 
Agricultural 
Products  or 
Processes 

Number  of  new  products  or 
processes  proposed 

Number  of  new  products  or 
processes  developed 

ENCOURAGE  BUSINESS  CREATION 
OR  EXPANSION 

Sub-Objective 

Indicators  of  Performance 

Assist 

Expanding 

Businesses 

Impact  on  local  economy 

Figure  8.  “(IDED  Program)  Balanced  Scorecard”  Example 
E.  CHAPTER  SUMMARY 

Figure  3  contains  the  Global  Objectives  Hierarchy  for  state  economic 
development.  To  construct  the  hierarchy,  a  sifting  process  was  applied  to  key 
stakeholder  documents  in  an  effort  to  identify  their  individual  economic 
development  objectives,  sub-objectives  and  specific  attributes.  Governor  and  State 
policy  objectives  set  the  ultimate  economic  development  objectives.  To  complete 
the  hierarchy,  each  stakeholder’s  specific  attributes  for  the  common  sub-objectives 
were  added.  Thus,  in  the  spirit  of  the  Government  Performance  and  Results  Act 
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and  Iowa’s  Budgeting  for  Results  effort,  a  Global  Hierarchy  emerged  that 
incorporates  each  stakeholder  group  into  the  objectives-setting  process.  Next, 
performance  indices  were  developed  that  objectively  measure  the  effectiveness  of 
the  IDED  programs. 

Objectively  measuring  the  results  of  the  IDED  effort  involves  tracking  the 
changes  within  a  city  or  county  toward  retaining  or  creating  quality  employment 
opportunities,  developing  new  or  innovative  agricultural  products  or  processes, 
and  encouraging  business  creation  or  expansion.  In  order  for  one  to  determine 
whether  the  IDED  program  is  responsible  for  significant  economic  changes,  a 
baseline  assessment  must  first  be  compiled.  Various  indicators  of  performance  can 
then  be  used  to  compare  economic  conditions  following  program  implementation 
with  the  baseline  assessment  to  get  a  clearer  picture  of  program  effectiveness. 
While  limitations  do  exist,  the  performance  indicators  proposed  in  this  chapter 
offer  an  alternative  to  the  lack  of  accountability  in  the  current  system. 
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VI.  CONCLUSION 


A.  INTRODUCTION 

The  Iowa  legislature  mandated  the  Iowa  Department  of  Economic 
Development  (IDED)  to  “enhance  the  economic  development  of  the  state  and 
provide  for  job  creation  and  increased  prosperity  and  opportunities  for  the  citizens 
of  the  state...”  (Code  of  Iowa,  1999).  Financial  incentives,  whether  as  direct 
fimding  to  an  industry  or  tax  credits,  are  an  investment  a  state  makes  in  its 
economic  future  and  in  a  public  partnership  with  the  private  sector  (Jones,  Jan  99, 
WWW. geocities.com').  Economic  development  programs  have  been  initiated  in  all 
fifty  states.  In  the  wake  of  the  federal  Government  Performance  and  Results  Act 
of  1993  at  the  federal  level,  many  state  governments  are  striving  for  greater  public 
accountability  of  their  programs. 

Performance  measures  are  becoming  increasingly  popular  among 
Midwestern  states,  as  skepticism  grows  over  the  value  of  incentive  packages 
designed  to  lure  individual  companies  or  to  reward  certain  activities  by  employers 
as  a  whole  (Firstline  Newsletter).  The  Iowa  Invests  legislation  of  1993  created  the 
Council  on  Human  Investment  which  was  charged  with  sponsoring  file 
development  and  implementation  of  performance  management  for  Iowa  State 
Government  (BFR  Handbook,  1997-1998). 
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Tin’s  study  addresses  how  the  IDED  can  measure  the  effectiveness  and 
performance  of  its  economic  incentive  programs.  This  chapter  will  summarize  the 
study’s  findings  based  on  the  original  research  questions. 

B.  RESTATEMENT  OF  RESEARCH  QUESTIONS 

Primary  Research  Question: 

What  are  the  essential  characteristics  of  a  performance  evaluation  system 
for  selected  EDED  programs? 

Subsidiary  Research  Questions: 

1.  What  are  the  challenges  to  performance  evaluation  of  public 
programs? 

2.  What  are  the  measures  of  success  for  economic  incentive  programs? 

3 .  What  are  appropriate  measures  of  performance? 

4.  Are  state  programs  evaluating  their  programs  with  appropriate 
measures? 

5 .  Is  there  data  that  exists  to  support  an  appropriate  evaluation? 

C.  SUMMARY  OF  FINDINGS 

1.  Challenges  to  Public  Sector  Performance  Evaluation 

Calhoun  concluded  that  the  obstacles  to  public  sector  performance 
evaluation  are  primarily  institutional,  technical,  and  financial  (Calhoun,  1998). 
Each  of  these  obstacles  presents  a  challenge  to  IDED  performance  evaluation. 
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a. 


Institutional  Obstacles 


Institutional  obstacles  are  characterized  by  the  influence  of  political 
pressure  on  performance  measurement,  the  effect  of  multiple  self-interested 
constituencies  on  objectives  consensus,  and  the  lack  of  experience  of  government 
managers  in  dealing  with  performance  data.  Each  of  these  obstacles  limits  the 
ability  of  IDED  program  managers  to  measure  the  effectiveness  of  their  programs. 

There  are  many  potential  groups  of  stakeholders  for  the  IDED.  They 
are  grouped  here  according  to  their  ability  to  influence  policy.  They  could  be 
grouped  according  to  their  support  of  economic  incentive  programs.  In  this 
grouping  there  would  be  members  of  the  same  organization  on  both  sides  of  the 
issue.  The  presence  of  so  many  stakeholder  groups  makes  the  setting  of  a  single 
set  of  economic  development  objectives  difficult.  The  Executive  Office  of  the 
Governor  sets  state  economic  direction  while  the  legislature  appropriates  the  funds 
necessary  to  fund  the  programs.  However,  both  have  similar  political  stakes  in  the 
performance  of  the  IDED.  The  economic  success  of  a  state  is  often  tied  to  the 
governor’s  policies.  The  majority  in  the  legislature  is  also  held  responsible  for  the 
success  or  failure  of  government  programs.  The  budgeting  decisions  made  by  the 
governor  and  the  legislature  are  often  interpreted  as  policy  decisions. 


71 


b. 


Technical  Obstacles 


Technical  obstacles  include  differentiating  between  output  and 
outcome  measures,  the  need  for  several  measures  of  performance  for  any  one 
program,  the  lack  of  standards  forjudging  governmental  performance,  and  the  lack 
of  timely  performance  feedback. 

Economic  development  presents  a  multitude  of  problems  and 
possible  solutions,  each  presenting  a  different  direction  for  the  IDED.  No  single 
measure  of  performance  is  adequate  to  handle  these  complexities.  IDED  officials 
must  develop  and  implement  multiple  measures  of  performance  simultaneously. 
Even  with  such  a  system,  no  standards  exist  that  indicate  whether  the  IDED 
assistance  is  “effective  enough”  to  merit  increased  or  continued  funding.  Periodic 
performance  reporting  must  be  compared  with  an  objective  baseline  assessment  of 
a  city  or  county’s  economic  characteristics  (collected  before  any  IDED  program 
assistance)  in  order  to  credit  specific  results  to  the  IDED  assistance. 

Additionally,  economic  development  programs  should  be  considered 
as  long-term  efforts.  They  should  be  geared  at  providing  long  term  growth  of  the 
economy.  Prediction  of  immediate  results  can  be  politically  hazardous  for  elected 
and  appointed  stakeholders. 
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c.  Financial  Obstacles 

Implementation  of  performance  measurement  systems  can  be  very 
costly,  especially  for  a  department  with  a  small  budget,  such  as  the  IDED.  A 
performance  evaluation  system  that  is  easy  to  use  and  can  be  implemented  without 
additional  funding  would  be  the  ideal  for  the  IDED. 

2.  Current  Measures  of  Success  for  Economic  Incentive  Programs 

The  current  measures  of  success  suffer  from  distinct  pathologies.  IDED 

reports  to  the  appropriations  subcommittees  each  year  how  many  dollars  were 
awarded  under  a  certain  program,  how  many  jobs  were  created,  the  average  wage, 
etc. 

3.  The  IDED  Performance  Evaluation  System 

The  spectrum  of  approaches  to  the  evaluation  of  public  programs  are 
anchored  at  one  end  by  the  “technically  rational  paradigm”  that  treats  performance 
measurement  as  an  objective,  scientific  aid  to  decision-making.  Anchoring  the 
opposite  end  of  the  spectrum  is  the  “politically  rational  paradigm”  that  emphasizes 
the  effect  of  political  power  on  the  measurement  of  performance  (Calhoun,  1998). 
The  politically  rational  paradigm  was  used  to  develop  the  following  four-step 
IDED  performance  measurement  process: 

1.  Identify  the  Key  IDED  Stakeholders; 

2.  Identify  the  Objectives  of  Economic  Development  and  the  IDED; 
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3.  Develop  Performance  Indices  for  the  IDED  Objectives; 

4.  Apply  technically  rational  performance  measurement  techniques. 

Only  steps  #1-3  were  completed  during  this  study.  Step  #4  was  beyond  the 
scope  of  this  study.  The  application  of  the  IDED  performance  indices  proposed  in 
Chapter  V  should  be  preceded  by  an  objective  baseline  assessment  in  each  city  or 
county  that  receives  IDED  assistance.  Program  managers  must  then  select  the 
indicators  of  performance  that  are  most  applicable  to  their  program.  A  tracking  of 
deviations  away  from  the  baseline  assessment  must  follow  in  order  to  establish  a 
stronger  cause  and  effect  relationship. 

4.  State  Program  Evaluation 

The  evaluation  of  state  economic  programs  by  state  governments  is  severely 
lacking.  Most  state  evaluations  can  only  determine  if  a  corporation  is  conforming 
to  the  program’s  rules.  Program  spending  can  be  captured  in  state  budget  reports 
but  this  doesn’t  give  any  indication  of  effectiveness.  Even  the  dollar  amount  can 
be  lost  because  few  states  track  tax  expenditures  associated  with  tax  incentives. 
The  tax  revenue  lost  to  tax  incentives  is  normally  considered  to  have  never  existed. 
The  assumption  is  that  the  only  reason  the  company  expanded  or  commenced 
operations  were  to  take  advantage  of  the  tax  incentives.  An  unrealistic  assumption 
in  the  face  of  millions  of  lost  tax  revenues. 
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As  government  becomes  more  accountable  for  the  money  it  spends,  maybe 
we  will  know  the  true  costs  of  economic  incentives. 

5.  Existing  Data  to  Support  Appropriate  Evaluation 

Following  from  the  previous  category,  there  is  little  data  to  appropriately 
evaluate  the  effectiveness  of  economic  incentive  programs. , 

D.  RECOMMENDATIONS 

1.  Recommendations  for  Further  Action 

It  is  recommended  that  IDED  consider  the  performance  indicators  proposed 
in  this  study  as  they  come  in  compliance  with  the  State’s  Budgeting  for  Results 
effort.  The  performance  indicators  provided  serve  mainly  as  examples  of  how  to 
work  through  the  process  of  developing  objectives  and  breaking  them  down  into 
performance  indicators.  The  development  of  a  standard  baseline  assessment 
format  is  required  to  provide  the  comparative  basis  from  which  to  measure  the 
effectiveness  of  the  IDED.  Any  movement  away  from  the  baseline  must  then  be 
tracked  and  presented  as  evidence  for  future  funding  decisions. 

2.  Recommendations  for  Further  Study 

This  study  was  completed  with  little  input  from  IDED  officials.  Building  a 
Balanced  Scorecard  of  IDED  performance  evaluation  indicators  requires  a  broad 
understanding  of  local  economic  conditions  and  business  practices.  The  indicators 
of  performance  proposed  in  this  study  must  be  refined  to  fit  the  specific  city  or 
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county  needs.  A  baseline  assessment  format  must  also  be  developed  so  that  future 
movement  toward  the  objectives  of  the  IDED  program  can  be  measured. 

In  order  to  begin  a  performance  evaluation  system  a  basic  assumption  is 
that  the  intentions  of  the  program  being  evaluated  are  themselves  worthwhile. 
This  thesis  did  not  explore  whether  or  not  states  should  be  in  the  business  of 
providing  economic  incentives  to  private  corporations. 

This  is  only  one  method  of  evaluating  the  effectiveness  of  economic  incentive 
programs.  A  regression  study  relating  outputs  to  inputs,  and  accounting  for 
impacts  from  general  economic,  environmental  and  political  conditions,  could  be 
conducted  to  establish  a  statistical  correlation  between  programs  and  outcomes. 
Studies  such  as  these  are  difficult  due  to  the  lack  of  quantitative  data. 
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APPENDIX.  IDED  PROGRAMS 
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IDED  Objective(s)  Method  Form  Requirement  Funding 

Program _ based  on: 

Community  Retain  or  create  quality  Financial  Loans  New  employment  #jobs 

Economic  employment  opportunities  ($1  million)  Forgivable  loans  Retain  existing  jobs,  make  new  capital  created/retained 

Betterment  investment 
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